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Abstract 

We consider a generalized multi-hop MIMO amphfy-and-forward (AF) relay network with multiple 
sources/destinations and arbitrarily number of relays. We establish two duahties and the corresponding 
dual transformations between such a network and its dual, respectively under single network hnear 
constraint and per-hop hnear constraint. The result is a generalization of the previous dualities under 
different special cases and is proved using new techniques which reveal more insight on the duahty 
structure that can be exploited to optimize MIMO precoders. A unified optimization framework is 
proposed to find a stationary point for an important class of non-convex optimization problems of AF 
relay networks based on a local Lagrange dual method, where the primal algorithm only finds a 
stationary point for the inner loop problem of maximizing the Lagrangian w.r.t. the primal variables. The 
input covariance matrices are shown to satisfy a polite water-filling structure at a stationary point of the 
inner loop problem. The duality and polite water-filling are exploited to design fast primal algorithms. 
Compared to the existing algorithms, the proposed optimization framework with duality-based primal 
algorithms can be used to solve more general problems with lower computation cost. 
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I. Introduction 

The amplify and forward (AF) relay technique is useful in wireless systems for cost-effective throughput 
enhancement and coverage extension. It has attracted many research works recently. The optimization of 
the MIMO (Multiple-input multiple-output) AF relay system has been well studied (see the tutorial paper 
|[lj and the reference there in). The optimal relay precoding matrix was established in |2] for a two-hop 
MIMO relay system and the result was later extended to multi-hop MIMO relay system in Q, where the 
optimal source and relay precoding matrices are shown to diagonalize the source-relay-destination channel. 
It was shown in Q that this diagonalization property also holds for power minimization of MIMO AF 
relay system under QoS constraints. However, the power minimization problem is still difficult to solve 
due to its non-convex nature |5J. A low complexity algorithm is proposed in |5| to closely approximate 
the solution of this non-convex problem for the two-hop case. The source and relay power allocation 
problem of the multicarrier two-hop AF relay system was studied in [6|. All of the above works focus 
on the case with a single relay at each hop. In [7], the power minimization under QoS constraints was 
addressed for a two-hop MIMO relay system with multiple relays. There are also some works on the 
optimization of multiuser MIMO AF relay systems. For example, the multiuser MIMO MAC (multiaccess 
channel) AF relay networks are addressed in |[8|, |[9|, while the MIMO BC (broadcast channel) AF relay 
networks are investigated in ||9|. Since the optimal structure of the source and relay precoding matrices 
is still unknown for multi-user MIMO AF relay networks, most of the algorithms in ||8|, ||9| are based 
on standard optimization methods such as Geometric programming ||8| and logarithmic barrier method 



|10|. For MAC/BC AF relay networks with single- antenna source/destination nodes, two dualities with 
respect to a total network power constraint and per-hop power constraint have been established in yjj. 



The results were later generalized to two-hop MIMO MAC/BC AF relay networks |12| and multi-hop 



MIMO AF relay systems 1 13 1. In some cases, the duality can be used to simplify the network optimization 
problem, e.g., some applications of the duality can be found in p3| , p4| . 

In this paper, we consider a generalized multi-hop MIMO AF relay network called the B-MAC AF 
relay network, which has multiple sources, multiple destinations and arbitrarily number of relays. The 
B-MAC AF relay network topology includes almost all the existing AF relay networks as special cases 
and the optimization of such general network has not been addressed in the literature. We derive structural 
properties of the optimization problem {duality and polite water-filling (PWF)) and exploit the duality 
and PWF structure to design efficient source and relay precoding algorithms for general B-MAC AF relay 
networks. For the special case of the single-hop B-MAC interference network (B-MAC IFN), the duality 



and PWF results have been established in |15|, |16|. However, due to the key difference in topology 
(single-hop versus multi-hop), there are various technical challenges and we cannot extend the existing 



results and algorithms trivially from 1 15 1, 1 16 1. Specifically, due to the multi-hop topology, the achievable 
rate is a complicated function of the input covariance and relay precoding matrices. This makes both the 
proof of dualities and the optimization of B-MAC AF relay networks much more challenging than the 
previous works with simpler network topology. Furthermore, the optimization constraints in the multi-hop 
B-MAC AF relay network is more complicated than that in B-MAC IFN. For example, the per-hop power 
constraint and per-relay power constraint are two practically important constraints that only occur in the 
multi-hop network topology. 

We propose several new techniques to solve these challenges. The main contributions are listed below. 

• Structural Properties (Duality) of MIMO AF Relay Network Optimization: We show that the 
achievable regions of a B-MAC AF relay network and its dual are the same under single network 
linear constraint (Type I duality) or per-hop linear constraint (Type II duality). We also derive 
explicit dual transformations to calculate the dual input covariance and relay precoding matrices. It 
is difficult to use the brute force computation approach in pT|-p3| to prove the duality for general 
B-MAC AF relay networks. We propose two new techniques, namely the network equivalence and 
the network dual scaling technique, to prove the Type I and Type II dualities. The proof is not 
only simpler but also reveals more insight on the duality structure. The duality and the network 
equivalence results are useful for MIMO precoder optimization in B-MAC AF relay networks. First, 



they are used in Section p^V-B| to derive the PWF structure of the optimal input covariance matrices, 
which can be exploited to design efficient input covariance optimization algorithm as illustrated in 
Section |IV-C2 Second, the duality is used in Section IV-C3 and IV-D to simplify the optimization 
of relay precoding matrices in BC AF relay networks. 

Efficient MIMO Precoder Optimization Algorithm for AF Relay Networks: Based on the duality 
structure established above, we propose efficient algorithms for MIMO precoder optimization in 
general MIMO AF relay networks. Since the duality is only established for single network / per-hop 
linear constraint, we cannot directly exploit the duality structure to handle general power constraints 
such as per-relay power constraint. To solve this problem, we propose a unified optimization frame- 
work to find a stationary point for an important class of B-MAC AF relay network optimization 
problems. In such a framework, we only need to design a primal algorithm to find a stationary 
point for the unconstrained inner loop problem of maximizing the Lagrangian. Using the network 



equivalence and duality results, we then show that at a stationary point of the inner loop problem, 
the input covariances have the PWF structure, which is a generalization of the PWF structure in 
B-MAC IFN 1 16] to the B-MAC AF Relay network. Finally, we propose several efficient primal 
algorithms based on duality and PWF structure for two-hop, three-hop, and multi-hop AF relay 
networks. The proposed algorithms have significant advantages w.r.t. conventional step-size based 
iterative algorithms (such as the gradient ascent method [ |17J and the logarithmic barrier algorithms 
in |[9|) in terms of complexity and convergence speed. It can also be used to solve a more general 
class of problems than the existing AF relay network optimization algorithms in |[T|, ||9|. 
The rest of the paper is organized as follows. Section [Tl] describes the system model, the achievable 



scheme and the preliminary results on rate duality for B-MAC IFN. Section III presents the main results 
on the two types of dualities for multi-hop B-MAC AF relay networks. In Section IV the duality is applied 
to study the non-convex optimization of B-MAC AF Relay networks. A unified optimization framework 
together with several primal algorithms are proposed to find a stationary point for an important class of 
B-MAC AF relay network optimization problems. The performance of the proposed algorithms is verified 
by simulation in Section [V] Section VI concludes. 



II. System Model and Preliminaries 

A. B-MAC AF Relay Network 

A B-MAC AF relay network is a general multi-hop AF relay network with multiple sources (trans- 
mitters), multiple destinations (receivers) and Q relay clusters as illustrated in Fig. [T] Each relay cluster 
can have multiple relays. Each node can have multiple antennas. We follow the widely used orthogonal 
assumption g, |[nj-|[l3l: 



Assumption 1 (Orthogonality among different hops). Due to propagation loss and proper channel reuse, 
the node in the q''' cluster only receive the signals from the {q — 1)'^ cluster, where the sources and 
destinations are considered as the 0''' and {Q + 1)''' cluster respectively. ■ 

We consider L data links between the sources and destinations. Each source can have independent 
data for different destinations, and each destination may want independent data from different sources. 
Assume the sources are labeled by elements in T = {Txi, Tx2, Txa, ...} and the destinations are labeled 
by elements in 7^ = {Rxi, Rx2, RX3, ...}. Define T/ {Ri) as the label of the source (destination) of the 
V-^ data link. The numbers of antennas at Ti and Ri are Lt, and Lr^ respectively. The total number of 
antennas at the (7* relay cluster is Lq. An example of B-MAC AF relay network is illustrated in Fig. 



[T] There are 2 sources, 2 destinations, and 3 data links, of which Ti = Txi, T2 = Txi, T3 = Tx2, 
Ri = Rxi, R2 = Rx2, and = Rx2. The figure also illustrates how to properly allocate sub-channels to 
achieve the orthogonality among different hops. In Fig. [TJ we assume that due to path loss, the aggregate 
interference from the nodes which are 2 or more hops away from the receiver is negligible. Hence we 
can avoid interference among the transmissions of different hops by dividing the whole bandwidth into 
3 orthogonal sub-channels and allocating different sub-channels to adjacent clusters. 

For convenience, we use link based notation for signals. Denote Hq G £_LixLt^ (j^g channel matrix 
between source T/ and the first relay cluster, e C^i+^^^i^ 1 < Q < Q — 1 the overall channel matrix 
between the and {q + 1)* relay cluster, and Hg G C^i^i^^Q the channel matrix between the 
relay cluster and destination Ri. Let G C^^*^^ denote the transmit signal of link k and assume it is 
a circularly symmetric complex Gaussian (CSCG) vector with covariance 5]^. Let Wg G C^«^^ denote 
the overall CSCG noise vector at the relay cluster with covariance W^. Then the composite received 
signal at the first relay cluster is = X]fc=i ^t^k + wi. The j'^ relay in the cluster applies linear 
transformation Fg (j) to the received signal and the resulting composite transmit signal from the g"^ relay 
cluster is = F^y^, where Fg = Block Diag [Fg (1) , ...,Fq (n^)] G C^"^^" is the composite relay 
precoding matrix, nq is the number of relays in the relay cluster, and = Hg_ix^_^ + v^q is the 
composite received signal at the relay cluster. For convenience, define 

Bq^q, = Fg.H^._iFg._i...HgFg, >(? (1) 

H;,fc = H^Bi,QHg, VA;,/. (2) 

Then using induction, it can be shown that the received signal at Ri is 

L Q 

yi = ^Ul,k^k + ^ilQBq,QWq+W^Q+^, (3) 

fc=l q=l 

where "vvq_^_^ G C^'^'^^ is the CSCG noise vector at Ri with covariance Wq_|_^. As an example, the 
equivalent channel model for the B-MAC AF relay network in Fig. [T] is illustrated in the lower sub-figure. 

B. Transmit/Receive Scheme and Achievable Rate 

We consider a centralized optimization scheme in which a central node computes all the input covari- 
ance and relay precoding matrices and then transmits them to the source and relay nodes. 

Assumption 2 (Assumptions on the CSI). The central node has the knowledge of the global channel 
state information ( CSI) Hq 's 's and Hq 's. ■ 
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Figure 1. An example of multi-hop B-MAC AF Relay Network and its equivalent channel model 
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Figure 2. Dual of the Multi-hop B-MAC AF Relay Network in Fig. [T] 
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Remark 1. In two-hop AF relay systems, both the source -relay and relay-destination channels can be 
estimated directly at the destination node by transmitting pilot signals p8| . However, acquiring global 
CSI in multi-user multi-hop AF relay networks is difficult and requires further study. In this paper, our 
main focus is to understand the first order optimization problem and solution properties in multi-user 
multi-hop AF networks. An interesting future work is to study efficient decentralized solution which does 
not require global CSI knowledge. The centralized solution in this paper provides the basis for studying 
the decentralized solutions. 

For fixed relay precoding matrix F^'s, the source nodes and destinations see an equivalent channel in 



([3]), which is essentially a B-MAC IFN studied in |15|, |19|. Therefore, we can adopt the same set of 
transmit/receive schemes as in |[T5|, (19). 

Assumption 3 (Assumptions on the transmit/receive scheme). 

1) Tlie transmit signal is CSCG. 

2) Each signal is decoded by no more than one destination and can be cancelled at this destination 
for the decoding of other signals. 

3) The interference among the source-destination pairs can be specified by some binary coupling 
matrix $ G {0,1}^^^. That is, \/k,l, after (possible) interference cancellation, the interference 
from Xfc to xi is given by (pi^i^tli^i^xi:, where cpi^k is the {I, k)''^ element of ^. Because (f)i^k £ {0, 1}, 
each interference is either completely cancelled or treated as noise. ■ 

The set of allowed transmit/receive schemes includes most interference management techniques as 
special cases, such as spatial interference reduction through beamforming, dirty paper coding (DPC) |l20l 



at sources and successive interference cancellation (SIC) at destinations 1 15 1. For example, in the B-MAC 
AF relay network in Fig. [1] suppose DPC is used at Txi with xi encoded after X2, and SIC is used at 
Rx2 with X3 decoded after X2. Then (pi^-^, 4>2,i, 4>2,3 and are 1 and all other elements of $ are 0. 

For given input covariance matrices "E = (Xli, S2, S^) and relay precoding matrices F = (Fi, F2, Fq), 
the covariance matrix of the transmit signal at the relay cluster is 

L q 



1 = 1 q' = l 

The interference -plus-noise covariance at Ri is 

L 

= W; + J](/>/,fcHz,fcSfcH[;„ (4) 

k=l 

where (pu = and 

Q 

W; = E H^B,,QW,Bt + W^Q^,. (5) 

9=1 

The achievable rate of the data link is |21 1 



If (s, F) = log I + Ui^iJ^iiilnY^ 

on which the achievable regions in this paper are based. 

We consider two types of linear constraints: Define the single network linear constraint as 



(6) 



E"=iTr EiW^o + E;=iTr S^W, < Pt, (7) 



where Wq and Wg are positive semidefinite; the per-hop linear constraint is defined as 

Ef=iTr (5];W[,) < Po, Tr W,) < P„ 1 < g < Q. (8) 



The above linear constraints are more general than the sum/individual power constraints considered in 
pl]|-p3|. The per-hop linear constraint is more relevant to practical systems. However, single network 
linear constraint is also important in practice because it can be used to handle the more general multiple 



linear constraints using Lagrange multiplier method as will be shown in Section IV 



C. The Dual of B -MAC AF Relay Network 

Definition 1 (Dual of a B-MAC AF relay network). The dual of a B-MAC AF relay network is obtained 
by the following operations. 1) Reverse the transmission directions, i.e., in the dual network, i?/'s become 
the sources, Tfs become the destinations, and the transmit signal of Ri travels through the Q^^ relay 
cluster, the {Q — 1)* relay cluster, the 1* relay cluster, and finally reaches the destination T;. 2) 
Replace all the channel matrices by their conjugate transposes, i.e., the channel matrix between source 
Ri and the relay cluster is Hg, the channel matrix between the {q + 1)* relay cluster and the 
relay cluster is hJ, q = Q — 1, and the channel matrix between the 1* relay cluster and destination 
Ti is Hq^. 3) In the dual network, the covariance of the noise at the (7* relay cluster is set as and 
the covariance of the noise at the destination Ti is set as Wq, where Wg's and Wq's are the linear 
constraint matrices in Q of the original network. 4) The coupling matrix for the dual network is set as 
the transpose of that for the original network, i.e., ■ 

As an example, the dual of the B-MAC AF relay network in Fig. [T] is illustrated in Fig. |2] 

We use the notation " to denote the terms in the dual network. Given input covariance matrices = 

^1^1, S2, S/,^ at the sources and relay precoding matrices F = ^Fi, F2, Fq^ at the relays, the 

covariance matrix of the transmit signal at the relay cluster is 



1=1 



q =q 



where 



K,' = Fj'H^'-iFj,_,...H,Ft, V<7' > q. (9) 



The interference -plus-noise covariance at Ti is 

Q L 
^1=^1 + Ho b1 ,^W,Bi,,H[, + </.fc,iHi,fcSfcHl,fc, (10) 

q=l k=l 



where Hi^k = Hq b| qHq ■ Hence, the achievable rate of the /"^ data link in the dual network is |21 1 



I? 



log 



Similarly, in the dual network, the two types of linear constraints are defined as 

Ef=iTr (tiW^Q+i) + E?=iTr (t^W,) < Pt, 
Ef=iTr (tiW^Q+i) < PQ,Tr (tfw,) < P^.^^'iq. 



(11) 

(12) 
(13) 



D. Rate Duality for One-hop B-MAC IFN 

The proof of the duality results in this paper relies on the rate duality for B-MAC IFN | |15| , which is 
a special case of the B-MAC AF relay network when Q = 0. Let 



[H;,fc] ,EziiTr {-^iWi) < Pt, [W^]) , 



(14) 



denote a B-MAC IFN where the channel matrix between and Ri is fc; the input covariance satisfies 
Tr ^Xl/W;^ < Pt; the noise covariance at Ri is W^. For fixed coupling matrix the interference- 
plus-noise covariance and the rate of link / is given by 



and Xf (S) 



log 



(15) 



k=l 



respectively. By definition, the dual network or reverse links is 



H 



k,l 



,E«=iTr S^W, <Pt 



The interference-plus-noise covariance and the rate of reverse link / is given by 

L 



(16) 



(17) 



andi*" (±) =log I + h|;EzH;,,^-i 



k=l 

respectively. 



The key of the rate duality is a covariance transformation p3| defined as follows. 

Definition 2 (Covariance transformation for B-MAC IFN). The covariance transformation of the input 
covariance Xl for a B-MAC IFN with parameters |[Hi ;j] , [W^] , W/ | as in ( 14 1 is defined by 4 steps. 
Step 1: Decompose the signal of each link I to Mi streams as 



where t/_m G C^'^'^'^ is a transmit vector with ||t/,„i|| = 1 and pi.,nS are the transmit powers. 



(18) 



Step 2: \/l,m, compute the MMSE-SIC receive vector as |[T5) 

/ Ml \ - 



(19) 



i—m+l 



where is chosen such that ||r; — 1. Calculate the SINR 7; „i as a function of {p;,m, r; „j} |T5| . 

Step 3: In the reverse links, use {r/ ,„} as transmit vectors and {t; ,,,} as receive vectors. Apply the SINR duality 
Jii) to obtain the reverse transmit powers q= gi^A/i , (7l,i, 9L,A/i]^: 



q = (D^ * 
where * e ' and the (^'ij Af, 4 



^ n. 



th / \ th 

row and -^^^i + ^) column of ^ is 



k,n 
l.m 



4>l.k 



k = I and m > n, 
k ~ I, and m < n, 
otherwise, 

, th 



D e M^' is a diagonal matrix with the ^'^i + ™) diagonal element given by 



(20) 



(21) 



ll.m/ 



tLw,tz,™V?,m. 



n= [nia,---,"-i,A/i,---,"-L,i,---,?^L,Afi] with hi,j 

Step 4: The Covariance Transformation from S to S is 



(22) 



(23) 



We restate the rate duality in 1 15| as follows. 



Theorem 1 (Rate duality for B-MAC IFN). For any Xl satisfying J2i=i ( '^i^i ) ^ -Pt and achieving 



a rate point r in the network {14), its covariance transformation '^i-l achieves a rate point v >v in the 



dual network {16) and satisfies Tr ( S^W; J = ( "^l^l ]■ Thus, the achievable regions in 



the forward and reverse links are the same under a single linear constraint. 



III. Duality Results for Multi-hop B-MAC AF Relay Network 

In this section, we establish two types of duality for multi-hop B-MAC AF relay network respectively 
under single network linear constraint and per-hop linear constraint. 



A. Type I Duality 

The type I duality can be established using the following network equivalence result. 
Theorem 2 (Network Equivalence). Fixing the relay precoding matrices F, the B-MAC AF relay network 



in Section II-A under constraint Q is equivalent to the following B-MAC IFN 



W, 



( [H/,fc] , EtiTr (5]^ W;) <Pt-Pc 
where H; fc, V/c, I is defined in (|2]), W| is defined in (jj]), and 

W; = EliH;,^Bt^W,Bi,,H|, + W(,, 



PC = Eg=lE%gbg,q' 



<1,<1 



rr (B,,,-W,B;^,W,, j >q. 



(24) 



(25) 



(26) 



Similarly, fixing the dual relay precoding matrices F = (f\, Fg j , the dual B-MAC AF relay network 



in Definition^under constraint (12) is equivalent to the dual network of (24) given by 



,Zi=iTr[^lWA<PT-Pc, 



W, 



(27) 



Please refer to Appendix [A] for the proof. Define the Type I dual transformation as follows. 



Definition 3 (Type I dual transformation). For any input covariance and relay precoding matrices X), F, 
let S be the covariance transformation of Xl in Definition |2j with parameters | [Hj^fc] , [W|] , Wj |. 
Then S and F = ^f|, Fg^ is called the Type I dual transformation of 5], F. ■ 

Then it follows from Theorem [T] and [2] that the following theorem holds. 

Theorem 3 (Type I duality). For any input covariance and relay precoding matrices XI, F satisfying 
Y.i=i Tr [y^iW]^ + Tr (T,fWg^ = P^ < Pt and achieving a rate point r in a B-MAC AF relay 

network, its Type I dual transformation S, F achieves a rate point r > r in the dual network and satisfy 
X;f=i Tr {iliW^Q^-^ + Tr (t^^Vsf^ = P!^. Thus, the achievable regions in a B-MAC AF relay 

network under constraint (0) and that in the dual network under constraint ( |i2| ) are the same. ■ 



B. Type II Duality 

Type II duality can be proved from type I duality using the conception of network dual scaling. 

Definition 4 (Scaled dual network). A scaled dual network with scaling vector d = [di, dg, dg+i]"^, 
where dq > 0, q = I, Q, and dg+i = 1, is obtained by scaling the covariance of the noise vectors in 



the dual network defined in Section II-C as follows: the covariance of the noise at the relay cluster 
is scaled to be d^+iWg, and the covariance of the noise at the destination T/ is scaled to be liiWQ. 
Furthermore, the relay precoding matrices is given by F 



Ft,..., Ft 



The following corollary follows immediately from Theorem |3] 

Corollary 1 (Duality for scaled dual network). For any input covariance and relay precoding matrices 
S , F achieving a rate point r in a B-MAC AF relay network, let S (d) be the covariance transformation 
ofTi obtained by Definition^with parameters | [H^ , [W|] , W| (d) |, where 



W'lid) = 5]H[,tBt^^d,+iW,Bi,,H[, + diW[,. 

5=1 



Then S (d) and F 



15 ■ 



(28) 



Q 1 achieves a rate point v >r in the scaled dual network with scaling 



vector d and satisfy the constraint 

L Q Q 

Tr (d) W^^i) + ^ rr (d) W,) = ^ d,^rP'^\ 



(29) 



1=1 



q=l 



q=0 



where 



= X:<QH;t|^,(d)H^B,,Q + X:d,^+iB;,^.W,'B,,, 

1=1 q'=q 
L 



W, 



Another theorem is needed to prove the Type II duality. Obtain {ti^m}, {ri,m}> * and D using (18 1, 
(19l, (21 1 and (22i in Definition j2j with parameters | [H/,fc] , [W; 



Define 



n^(D-i-*^) 'n,',Vg,g' G {0,1,...,Q}, 



q,q 



(30) 



where n„ 



Q 1 <? <? 

"■l,!' •••'"'l,Afi' •••'"'L,l' •••'"'L,Mi 



and V/, m, 



fli 1 , . . . , Til 



9-1 


= rtn^H^B,,QW,BjQH3r,,„, g = l,. 






Q 






(31) 


'■ Q 


- 9 

■■^'^L,Ml 


T 

and V/, m, 










■,Q 






= tt^w[,tz,^. 




(32) 



Define A G 



j{Q+l)x(Q+l) 



whose (g, (/ )* element is 



otherwise 

Theorem 4 (Network Dual Scaling). Consider the following eigensystem 

Ad = Amaj;d , 



(33) 



(34) 



where d /i' f/je dominant eigenvector and Xmax is the maximum eigenvalue of A. Then X^ax and d must 



be strictly positive. Let d 



1 



f/je dominant eigenvector of A iv/f/i f/ie Za^f component 



scaled to one. Then in the scaled dual network with scaling vector d, 5] |^d j defined in Corollary jij and 
F= (^fJ,...,F^^ satisfies 

EtiTr (ti (d) W^j+i) = < Pq, (35) 
rr ( S^^ fdWj = dgP'ii < q = 1, ...Q. 



The proof is given in Appendix IB] Define the Type II dual transformation as follows. 



Definition 5 (Type II dual transformation). For any input covariance and relay precoding matrices S, F, let 



where d 



di, 



, do, 1 



S ( d ) be the covariance transformation of S in Definition with parameters 



is the dominant eigenvector of the eigensystem in (|34|. Then 5] and the dual 

t ;;„-pt 



relay precoding matrices F = F |^dj = (^ciF{, ...jCqFqJ, where cq = l/ydq, c, 
1, (5 — 1, is called the Type II dual transformation of Xl, F. 



W,(d 



dq+i/d, 



9' 



For the same input covariance Xl = S ^d j , the rate point in the scaled dual network with scaling 
vector d and relay precoding matrices ( f| , . . . , Ft, ) is equal to that in the original dual network with relay 



precoding matrices F = F ( d I . Furthermore, it follows from ( 35 1 that the Type II dual transformation 



XI, F satisfies (13 1. Combining the above and Corollary Ml the following theorem is proved 



Theorem 5 (Type II duality). For any input covariance and relay precoding matrices 5],F satisfying 

- Pq ^ Pq, Vf/, and achieving a rate point r in the 



P^^ < Po, rr(s«w. 



B-MAC AF relay network defined in Section II- A its Type II dual transformation XI, F achieves a rate 
point r > r in the dual network and satisfy ^'^ (^'^Q+i) ~ ^Q' {^q^^o^ ~ Pq-i^ "^9- Thus, 

the achievable regions in a B-MAC AF relay network under constraint and that in the dual network 



under constraint {13) are the same. 



Remark 2 (Generality of Type I/II duality). The previous duality results for various special cases are 
compared to illustrate the generality of the Type I/II duality. In ||TTJ and p2| , the duality was established 
respectively for multi-hop MAC/BC AF relay networks with single-antenna source/destination nodes and 
two-hop MIMO MAC/BC AF relay networks. However, the approach in pT| , |12| cannot be easily 



extended to the general B-MAC AF relay network. The duality for multi-hop MIMO AF relay system 
was established in |13j. Although the proof can be extended to multi-user AF relay networks by using 
block diagonal preceding / receiving matrices and the notion of independent streams, the duality in [3] 
cannot cover the duality in this paper as elaborated below. 

1) The B-MAC AF relay network is not captured by the system model in (13). In p3|, there are Ni, 



independent data streams in one transmission. Similar to the coupling matrix defined in Assumption [3j 
we can use a binary inter-stream coupling matrix G {0, ij^tx^i- to specify the interference among 
the data streams. In |fT3|, can only have two forms: a) if linear transceivers are used at the source 
and destination nodes, all the diagonal elements of are zero, and all the off-diagonal elements of 
are one; b) if non-linear transceivers are used, is a triangular matrix. However, for general B-MAC 
AF relay networks, if we decompose the equivalent MIMO links into independent data streams, the 
inter-stream coupling matrix can be any binary matrix with zero diagonal elements. 



2) Explicit dual transformations are not part of |13| for the multi-user case with general inter-stream 



coupling matrix The dual transformation between the DPC-based and SIC-based MIMO AF relay 



systems in 1 13| cannot be generalized to B-MAC AF relay networks because the matrix in (14) of 
1 13 1 is no longer upper- triangle. 

Furthermore, the above special cases consider power constraints only. By using the techniques of 
network equivalence and network dual scaling, we are able to establish the dualities and explicit dual 
transformations for B-MAC AF relay networks under more general linear constraints. The duality proof 
based on these new techniques is not only simpler but also reveals more insight on the duality structure 
that can be exploited to design MIMO precoder optimization algorithms as shown in the next section. 

IV. Applications in Network Optimization Problems 
We propose an unified optimization framework to find a stationary point for a class of AF relay network 



optimization problems based on the local Lagrange dual method (LDM) |23 1, where the primal algorithm 
only finds a stationary point for the inner loop problem of maximizing the Lagrangian. The duality is first 
used to characterize the PWF structure of the input covariance matrices at a stationary point. Then the 
duality and PWF are exploited to design efficient primal algorithm for general B-MAC AF relay networks 



and structured primal algorithms for BC AF Relay network. 



A. Unified Optimization Framework based on Local LDM 

A general optimization problem in a B-MAC AF Relay network can be expressed as 

max / (E, F) , s.t. c/„ (E, F) > 0, n = 1, A^, and ^ 0, / = 1, L, (36) 

where / (S, F) and gn (S, F) , Vn are real valued functions of Xl, F. In this paper, we consider a class 
of problems whose Lagrangian can be written in the following form 

N 



L(S,F,A) ^ /(5],F) + J]A„5n(S,F) 



n=l 

L L Q 

= wiZf (S, F) - J] Tr (S,W[,) - ^ Tr (sf W,) , ^ 0, (37) 

1=1 1 = 1 q=l 

where A = [A„ > 0]n=i n Lagrange multipliers, Wq, V/ are positive semidefinite, Wg are 
positive definite, and wi > 0, V/. The Lagrangian of many important optimization problems can be 



written in the form of (37). Two typical problems are listed below. 
PI: Maximize the weighted sum-rate under multiple linear constraints: 

L 

max Yfiilf{^,F) (38) 

1=1 

L Q 

S.t. Yl (s^Wi) + ^ Tr (sf W„,g) < Sn, n = 1, N, and h 0, V/, 

1 = 1 q=l 

where fii > 0, V^, W^'s and W„ g's are positive semidefinite and (5„ > 0, Vn. 

P2: Minimize a single linear cost under individual rate constraints: 

L Q 
min J]Tr(SiW[,) +^Tr(sfW,) (39) 

1=1 q=l 

S.t. Xf (S, F) > I?, / = 1, L, and >z 0, V^, 
where > is the rate constraint for the data link. 

Remark 3 (Per-relay power constraint). The multiple linear constraints in PI include the per-relay power 
constraint as special cases. Let rig denote the number of relays in the g'^ relay cluster, and let Lgj 
denote the number of antennas at the relay of the q^^ relay cluster. Then the power constraint Pgj 
for the J* relay in the relay cluster can be expressed in the form of the general multiple linear 
constraints in PI as Zti Tr (S/W^,) + ^^^^ Tr (sJW^^g-) < 5„ by setting 5„ = P^j, = 0, V/, 



^n,g' = / and Wn,q = BlockDiag [Oi, Oj_i, Ij, O^+i, O^J , where Ij is an L^j x Lqj 

identity matrix and , V/ 7^ j is an x j' zero matrix. 



It is well known that the problems in (38 1 and (39 1 are usually non-convex problems with non-zero 



duality gap. Hence, the standard Lagrange dual method (LDM) |10| cannot be used to solve these 
problems. In [23], we proposed a local LDM to find a stationary point for a non-convex problem. We 



apply the local LDM to obtain the following algorithm for problem (36). 



(40) 



Algorithm LLDM (for Finding a Stationary Point of Problem (36l): 
Initialization: Choose initial A^^^ such that A^*'^ > 0, Vn. Let i = 1. 

Step 1 (Primal update in the inner loop): For fixed A = A*^*"^-', find a stationary point Sf'^i)^ f of 

max iA(S,F) ^ L (S, F, A) , s.t. ^ 0, V^, 

S ,F 

using some primal algorithm with initial poinj^ S^*^^^ F*^*^^^. 
Step 2 (Dual update in the outer loop): Update A as 

A(') = A(^-i) +i(^)zW, (41) 

where t*^*^ is the step size, and z*^*^ is the optimal solution of the following quadratic programming problem: 



where g'*) 



9i ,-,9n 



min z^gW + -z^jWz, s.t. A^^'^^ + z > 0, 
z 2 

with gi'^ ^ 5„ (s(^-i),F(^-i)) , Vn, and e I 



(42) 



t,NxN 



is positive definite. 



Return to Step 1 until convergence. 



Choice of t lie Matrix J*^*^." J*^*) is obtained by the well known BFGS update as follows |24| 



J*^*\ otherwise, 
p, = A«-A(-l),q, = g('+l)-gW. 



The initial = 2™'' I, where mf, is the smallest positive integer such that max |z„| < 0.5, and z = [zi, zjv] is 

n 

the optimal solution of the problem max z^'^g^^-' + ^z^J^^^z,. 



'Note that ^^F*^ is randomly generated. 



Choice of the Step Size t^^\' Set t*^*) = a'^')2 where rrit is an integer which is initialized as and is 
incremented until one of the following conditions is satisfied: 1) L (S(^), F^*), A^*)) < L (S'^-i), F('-i), A'^^i)). 
2) nit = m°, where is a small positive integer, e.g., we let m° = 2 in the simulations. 3) rci < ret-i, where 

re, =max|A«.9„ (sW,F«)| + (max {s,, (s«,F«)})^, (43) 

is defined as the residual error after the iteration. Finally, a^*' is given by 

a(^+i) = (l-/3)aW+/3t«, 

where < a'^^) < 0.5, < /3 < 1 and are set as a^°^ = 0.25, /3 = 0.2 in the simulations. 



Algorithm LLDM converges to a stationary point of Problem ( |36| ) under mild conditions p3j . In the 
subsequent sections, we first characterize the PWF structure at a stationary point of Problem (40). Then 
we design several efficient primal algorithms based on the PWF and duality. 

B. Structural Properties of a Stationary Point 

At any stationary point of Problem ( |40| ) with fixed relay precoding matrices F, the input covariance 
matrices S must satisfy a PWF structure as stated in the following corollary. 



Corollary 2 (PWF for fixed relay precoding). Let be a stationary point of problem ( |40| ) with fixed F, 
i.e., £) satisfies the following KKT conditions 

Vs,La(^,F) < 0, V/, 

rr(S,Vs,LA(S,F)) = 0, V/. (44) 

Then the Type I dual transformation of ^, F is S, F = (f|, Fq^, where S = (l^i, with 

ti = wi (ci;^ - (ni + Ui^i%ul) , yi. (45) 



Obtain the interference-plus-noise covariance matrices Cli's from (Wl) using S,F and the dual ones Qi's 



. * — — ^ ^ —1/2 

from (10) using 5], F. For each I, create an equivalent channel: H/ = fi^ ^$7^ . Perform the thin 



SVD Ui = EiAiG], where E/ G C^"-^^', G C^nxN,^ ^ R^'^^', and Ni = Rank (H,,,). Then, 
S must have a polite water-filling structure, i.e., 

Qi ^ = Gi {wil - A-2)+ g], VL (46) 

Furthermore, Xl also possesses the polite water-filling structure, i.e., 

Qi ^ ny^±iCiy^ = Bi {wil - A-2)+ e], yi. (47) 



On the other hand, if certain 5] has the above polite water-filling structure for a given F, it must be a 



stationary point of problem {40) for this fixed F. 



Corollary [2] follows straightforward from the PWF results for B-MAC IFN in Theorem 3 of fW\ and 
the network equivalence result in Theorem [2] The detailed proof is omitted due to limited space. 

In some cases, better algorithms can be designed by considering the following dual network problem. 



Definition 6 (Dual network problem). The dual network problem of (40 1 is defined as 

L 



max 

S.F 



La (s, ^)=Y, wiXf (S, f) - J] Tr (^,W^+i) - ^ Tr (sf W^) , s.t. % >z 0, V/. (48) 



1=1 1=1 q=l 



Tlieorem 6 (Equivalence of problem (40 1 and its dual). For any stationary point II, F of dual network 



problem {48), its Type I dual transformation S,F must also be a stationary point of problem {40). 



Please refer to Appendix |C] for the proof. 

C. Primal Algorithms for two-hop B-MAC AF Relay networks 

We present several primal algorithms for two-hop B-MAC AF Relay networks. In this case, the relay 
precoding matrices is F = BlockDiag [F (1) , F (ni)], where F (j) G ^^^^-^ is the relay precoding 
matrix at the relay, Lij is the number of antennas at the relay, and ni is the number of relays. 

1 ) Gradient Ascent Primal Algorithm : The gradient ascent (GA) algorithm with the step size de- 
termined by Armijo rule p7| can be used to find a stationary point of Problem (|40]l as summarized in 
Table |l] In Algorithm GA, the gradient update for source node is performed over the precoding matrices 
T^'s, where T^tJ = 5];, VL For convenience, we group the gradients over F{j),j = as a 

block diagonal matrix Vf(i.„^) (S, F) = BlockDiag [Vf(i)La (S, F) Vf(„i)La (S, F)] . Then the 
gradients required in Algorithm GA are given by |[25| 



Vt,La (5], F) = -2W;T, + 2wiUlXY'Ui,iTi - 2 J] Wk(l)k,i'H.li ("fc ' " ^k') ^k,iTi, VZ, (49) 
Vf(i,„,) (S, F) = BlockDiag [li, 1„J o VfLa (S, F) , (50) 

where X; = fli + H/ ^SiH^^, V/; the notation o denotes the pointwise product of two matrices; ^jj^j € 
{1, ni} is an Lij x Lij matrix of which all the elements are ones; and Vf^a (S, F) is given by 

L L 

VfLa (S,F) = 2^wi (u^^X^^Ai - H'l^n^-iQ) - 2 J] WiFH[,SjH[)t - 2WiFWi, (51) 

1=1 1=1 

where A; = H'^F (zLi </'z,fcHg5]fcH^t+ H^S^H^j^ + Wi), and Ci = U{F (eLi (l>i,kil^^kilo^ + Wi 



Table I 

Algorithm GA (Gradient Ascent Method for Finding a Stationary Point of Problem ( |401 i) 



Initialize T;, V/ and F=BlockDiag [F (1) , F (ni)]. 
Do 

1. Calculate the gradient over T/'s using (|49ji: G[ = Vti^a (S, F) , l^l,...,L. 

2. Choose step size a via Armijo rule and update Tj's as T( = T; + aGj , I ~ 1, L. 

3. Calculate the gradient over F (j)'s using (jsoj): = VF(j)Lx (S, F) , j = 1, ni. 

4. Choose step size a via Armijo rule and update F as F (j) — F (j) + aG^,j = 1, rii. 
until all the norms of Gj , V/ and G^, Vj are small enough 



2 ) Polite Water-filling based Primal Algorithm: We exploit the duality and PWF structure to design 
Algorithm PWF as summarized in Table [n| By Corollary [2] and the property of gradient update for F(j)'s, 
if Algorithm PWF converges, the solution must be a stationary point of problem (|40]l. Simulations show 
that Algorithm PWF has a faster convergence speed than Algorithm GA. 

3 ) Structured Primal Algorithm for two-hop BC AF relay networks: Consider sum rate maximization 
under multiple linear constraints (i.e., problem ( [38] ) with fii = 1, V/) in a two-hop BC AF relay network 
applying DPC. We apply the duality and Corollary [2] to design a structured primal algorithm to find a 
stationary point of the inner loop problem ( [40] ) for this special case. 

Note that in this case, Q = 1, Hq, VZ are the same, and Wq, V/ are the same. For convenience, let 



bi 



w 



,Wb,wn, 



(52) 



denote a two-hop BC AF relay network where the channel matrix between source and relay is Hq = 
Hb, V/, the channel matrix between relay and the destination is Hg = H^,, the covariance of the 
noise at the relay is Wi = Wjj, the covariance of the noise at the destination is W2 = W[, and the 
constraint matrices in Lagrangian (37) is Wq = Wb, VZ, Wi = WJj. The dual network of (52) is 



H 



) -'--'-mi »» m' n 



(53) 



which is a two-hop MAC AF relay network where the channel matrix between the l^^ source and relay is 



H 



h|,^, V/, the channel matrix between relay and the destination is Hn 



hJ, the covariance of the 



noise at the relay is W[jj = Wf,, the covariance of the noise at the destination is Wm = Wb, and the 
constraint matrices in Lagrangian ^ is Wl^ = Wl, V/, W;„ = Wj;. By Theorem lei Problem (M for 



the BC relay network (52) can be equivalently solved by solving the dual network problem (48), whose 



Table II 

Algorithm PWF (PWF based Algorithm for Finding a Stationary Point of Problem ( |401 i) 



Initialize S and F = BlockDiag [F (1) , F (tii)] such that h 0, VL 



Obtain the initial S from (45 i using the initial S. 
While not converge do 

1. For fixed S and F, update S by polite water-filling: 
Obtain Cli = W; + X]fc=i ^k,itii i'^kAk,i, where W; is given in 
For Z = 1 to L 
a. Obtain fti using (4i 



b. Perform thin SVD $7, ^/^H/,,0; = E,A,G|, yi 

0-1/2 



■Gi (wil 



tr)-i/2 



c. Update S/ as S/ 
End 

2. For fixed S, update F as F (j) = F (j) + aVF(j)iA (S, F) , j = 1, . 
where the step size a is obtained by Armijo rule. 

3. For fixed S and F, update S by polite water-filling: 
Obtain fli, V/ using (4i. 

For Z = 1 to L 
a. obtain tti = W, 



Sfe^i *fcjHj^ (SfeHfe,;, where is given in (|25|l. 



b. Perform thin SVD Q, 

c. Update as S/ = $7; 
End 

End 



-l/2fj 



-1/2 



-1/2 



Ez A;-') ETJI 



-1/2 



objective function, in this special case, is given by 

H„,FRFtHt, + H„,FW:,FtHl„ + w„ 



log 



H^FW!;,FtHi, + W„ 



Tr (f (R + W;,) Ft W;„) - ^ Tr (tiW^) , 



1=1 

where R = Y.ti ^L^i'^ll 

By exploiting the specific structure of Lx, we propose an improved algorithm over PWF. 

Algorithm PWFI: 

Initialization: Choose proper initial S, F such that S; ^ 0, V/. 



Step 1: For fixed F and S^, Vfc ^ I, Problem (48 i reduces to the single-user optimization problem: 



max log 



Tr ( SjWi 



where Hj = H„FH;,, = H^F H,^SfcH,^^FtH,UH„FW[„FtHt,+W„„ and = HL^FtW^FH^, 
Wjj,. Applying Corollary [2] to the single-user optimization problem in (55 1, the optimal solution is given by 



s, = w, '^'g, fi- a 



where G; and A; are obtained by performing the thin SVD Wj ^''^HiW; = E;A;Gj. Update each S/ for 



-1/2 



V/, 



(56) 



-1/2 



once using (56i when fixing F and Sfc, Vfc 7^ I. 

Step 2: For fixed S, F is updated by solving max L\ ^S, F^, which is equivalent to the following problem 

fltFtRFH + fitFtpH + I 



max log 

F 



HtFtFH + I 



- Tr (FT (R + I) F) , 



(57) 



where H = Wi; 



-1/2 



nlwj^\ F = (W[ji/' Ft ( 



1/2 



and R== (W;„)"^''^ R (W^)"''^ Define M = 
min (Rank (fl) ,Rank (R))- Perform the SVD H — U^D^V;j and the eigenvalue decomposition R = Uj,D,rVr. 
Let (Ti, (Tm denote the M largest singular values of H with descending order and \Jff denote the semi-unitary 
matrix formed by the singular vectors corresponding to Ci's. Let 61, 6m denote the M largest eigenvalues of R 
with descending order and U*^ denote the semi-unitary matrix formed by the eigenvectors corresponding to Si's. 
Then the optimal F is given by ||9J 



1/2 



F=(w^)"'^'ufD,U^^t(w^ 



-1/2 



(58) 



where D/ = diag (/i, /m)^^^ > with i = 1, M given by 

1 



2a2 {6, + 1) 



Sf + 4S,a? -5,-2 



Return to step 1 until convergence. 

Since the objective L\ ^S, is upper bounded and is increased after each update, Algorithm PWFI 
must converge to a fixed point F. It can be shown that the fixed point S, F must be a stationary point 
of the dual network problem (48 1. Then by Theorem |6] the corresponding Type I dual transformation 



S,F is a stationary point of Problem (40 1 in the BC relay network (52i. 



D. Primal Algorithms for Multi-hop B-MAC AF Relay Networks 

Algorithm GA/PWF can be easily extended to solve Problem ( [40] ) for B-MAC AF relay networks with 
more than two hops. The only difference is that the gradient update of the relay precoding matrices is 
generalized to multi-hop case as 

Fg(j) = Fg(i) + aVF,o)LA(S,F), (? = = l,...,ng, 



where the gradient VY,(j)Lx (5], F) , Vg, j can be calculated similar to the one in (50 1. 



The duality can be used to simplify the the sum rate maximization under multiple linear constraints 
for a three -hop BC relay network. We design Algorithm PWF3 to find a stationary point of the inner-loop 



problem (40 1 for this special case, where H[) = Hq, V/, wi = 1, V/ and W[) = Wq, V/. Algorithm PWF3 
switches the optimization between the original network and the dual network so that at each time, we 



only need to consider a two-hop network optimization problem solved in Section IV-C3 
Algorithm PWF3: 

Initialization: Choose proper initial S,F = (Fi,F2) such that S; >: 0, VL 



Step 1: For fixed Fi, the inner loop problem reduces to Problem (40i in the two-hop BC AF relay network (52i 
with Hb = HiFiHo, = H^, V/, = HiFiWiF|h1 + W2, W(, = W^^^, V/, Wb = hJ,f1WiFiHo + 
Wo and Wj, = W2. Obtain the input covariance and relay precoding matrices S5 = , F^ for the 



dual two-hop MAC AF relay network (53 1 by the Type I dual transformation of S,F2 applied to network (52i. 



Update each for once using (56 1 when fixing F;, and S^', Vfc 7^ I. Then update F;, using (58 1 for fixed Sf,. 



Finally, obtain the updated S, F2 by the Type I dual transformation of S;,, Ff, applied to network (53 
Step 2: Obtain S, F by the Type I dual transformation of S, F. 



Step 3: For fixed F2, update S,Fi by improving the objective value of the dual network problem (48 1, which 



reduces to Problem (40 1 in the two-hop MAC AF relay network (53 1 with = H|r2H^, Wl, = hJ,, 
- hIF2W2F^Hi + Wi, W,n = Wo, W^ = H^F^W2F2H^ + W^^i, and W;„ = Wi. Treating S, Fi 
as the input covariance and relay precoding matrices in network (53 1, update S,Fi using a single iteration of 
Algorithm PWFI appUed to network (|53]l. 

Step 4: Obtain S, F by the Type I dual transformation of S, F. 

Return to step 1 until convergence. 

Using Theorem [3j it can be shown that Algorithm PWF3 monotonically increases the objective after 
each iteration and converges to a stationary point of Problem ([40]). 



Remark 4. For the special case of B-MAC IFN, the duality and PWF have been established in 1 15 1, um. 



However, we cannot extend the existing results and algorithms trivially from |15|, |16|. We proposed 
new techniques, namely the network equivalence technique in Theorem |2j and the network dual scaling 
technique in Theorem [4j to generalize the duality and PWF to B-MAC AF relay networks. The proof 
of Theorem [4] is non-trivial. The algorithm design also relies on the new network equivalence result. 
Moreover, Theorem [6] (equivalence of problem (40 1 and its dual) is non-trivial and cannot be re-derived 



from our previous results in |15|, |16|. Based on Theorem |6j we proposed structured primal algorithms 
(PWFI and PWF3) which are entirely different from the single-hop PWF algorithms in p3| , | [T6[ . 
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Figure 3. Convergence comparison for the B-MAC AF relay Figure 4. Convergence comparison for a two-hop MAC AF 
network in Fig. [T] relay network 



V. Simulation Results 

Block fading channel is assumed and each channel matrix has zero-mean i.i.d. Gaussian entries with 
unit variance. The simulation results in all figures are averaged over 100 random channel realizations. 



A. Verify the Convergence of the Proposed Primal Algorithms 



The parameters of Problem (40l are set as wi = 1, Wq = O.OII, Wg = O.OII, VZ. For accuracy 



comparison, define the convergence error as the sum of the norms of the gradients over F and all T;'s. 



We first demonstrate the advantages of Algorithm PWF over GA described in Section IV-Cl Consider 
the B-MAC AF relay network in Fig. [T] with Q = 1 (two-hop), ni = I relay, and L^, = 4, Lr^ = 2, VZ, 
Li = 4 antennas at each node. In Fig. |3] we plot the average objective value and the convergence error 
versus the number of iterations. It can be observed that PWF has faster convergence speed than GA. It 
also achieves a higher objective value. The complexity order per iteration of PWF and GA is similar. 
However, the overall complexity of PWF is lower because it avoids the linear search for the gradient 
update of S, and requires less iterations to achieve the same accuracy. 

In Fig. [4j we compare the convergence of Algorithm GA, PWF and PWFI for a two-hop MAC relay 
network with L = 4 sources, ni = 1 relay and Lt, = 2, Li = 4, L/j, = 4, \/l antennas at each node. 
The results show that PWFI has the fastest convergence speed. PWFI also has the lowest complexity 
because it avoids the linear search in the gradient update. 
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Figure 5. Convergence of Algorithm PWF3 for a three-hop Figure 6. Average sum-rate/CPU time versus power con- 
BC AF relay network straint at relay for a two-hop BC AF relay network 



Finally, we verify the convergence of Algorithm PWF3 for a three-hop BC relay network with Ug = 
l,q = 1,2 relay at each relay cluster, L = 4 destinations and Lt, = 4, V/, Lg = A, q = 1, 2, L/j, = 2, \/l 
antennas at each node. Fig. [5] plots the average objective value and objective error, defined as the gap 
(in logarithmic scale) from the stationary point that the algorithm converges to, versus the number of 



iterations. Algorithm PWF3 quickly converges to a stationary point of problem (40 1 with high accuracy 



B. Advantages of the Proposed Local LDM with Duality-based Primal Algorithm 

In Fig. [5] and [6j we consider Problem (38 1 with /i; = 1, V/ (i.e., sum-rate maximization) and illustrate 
the advantages of the proposed local LDM with duality-based primal algorithms (i.e.. Algorithm PWF 
or PWFI). The following baseline algorithms are compared. 

• Baseline 1 (Algorithm 3 in [9]): Algorithm 3 in |9] is based on logarithmic barrier method [10] and 
is designed for sum-rate maximization under power constraints in two-hop BC relay networks. 

• Baseline 2 (logarithmic barrier algorithm): This is an extension of the Algorithm 3 in |9| to B-MAC 
AF relay networks using the logarithmic barrier method | |10| . 

• Baseline 3: Local LDM with GA as the primal algorithm. 

We first evaluate the performance in a two-hop BC relay network with ni = 1 relay, L = 4 destinations 
and = 4, V/, Li = 4, L/j, = 2, V/ antennas at each node. Assume a sum power constraint at the 
source: X]f=iTr (5];) < 10, and a power constraint at the relay: TriJl^) < Pr. In Fig. ^ we plot the 
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Figure 7. Average sum-rate/CPU time vs. power constraint 
at each relay for the B-MAC AF relay network in Fig. [T] 



Figure 8. Average sum power/CPU time versus individual 
rate constraint for a two-hop MAC AF relay network 



average sum-rate, and the CPU time required to achieve the same accuracy, versus the power constraint 
at relay Pr. All algorithms achieve similar sum-rate. However, LLDM with both PWF and PWFI clearly 
outperform the Algorithm 3 in [9] in terms of CPU time. 

In Fig. [7} we evaluate the sum-rate and CPU time performance in the B-MAC AF relay network in Fig. 
[3] with Q = 1 (two-hop), ni = 2 relays, Li j = 2,j = 1, 2 antennas at each relay, and Ly, = 4, L/j, = 
2, V/ antennas at each source/destination node. Consider individual power constraints at each node: 
X;LiTr(SO < 10, Tr(5]3) < 10, Tr (Ef BlockDiag [Ii, O2]) < Pr and Tr (Sf BlockDiag [d, I2]) < 
Pr. All algorithms achieve similar sum-rate. However, LLDM with PWF requires the least CPU time. 

In Fig. pi we consider Problem (39 1 with Wq = I, V/, = I, Vg (i.e., sum power minimization). 



and = V/ for a two-hop MAC relay network with L = 3 sources, ni = 1 relay and L^, = 2, V/, 
Li = 4, L/j, = 4, \/l antennas at each node. The proposed LLDM with PWF is compared to baseline 
3 and baseline 4: Algorithm 9 in [9] (joint search based on logarithmic barrier method). We plot the 
average sum power and the CPU time versus the individual rate constraint (I^). All algorithms achieve 
similar sum power. However, LLDM with PWF requires the least CPU time. 



VI. Conclusion 

We show that the achievable regions of a multi-hop MIMO B-MAC AF relay network and its dual are 
the same under single network linear constraint or per-hop linear constraint. Two dual transformations 



are provided to calculate the dual input covariance and relay precoding matrices. These results include 
the duaUties in pT|-| 13 1 as special cases. Furthermore, our proof is simpler and reveals more structural 
property of the duality. Based on the established duality structure, we propose efficient algorithms for 
MIMO precoder optimization in B-MAC AF relay networks. First, a unified optimization framework is 



proposed based on the local Lagrange dual method in 1 23 1 so that we only need to focus on designing 



a primal algorithm to find a stationary point of the unconstrained inner loop problem. Using duality, we 
characterize the polite water-filling (PWF) structure of the input covariance matrices at a stationary point 
of the inner loop problem. Then, the duality and PWF are exploited to design efficient primal algorithms. 
The proposed local LDM with duality-based primal algorithms has lower computation cost and faster 
convergence speed than the conventional step-size based iterative algorithms. 



A. Proof of Theorem [2] 



It follows from = that 



B 



9,9 



Appendix 



Vg > q. Hence the equivalent channel of the dual network 



is H 



i,k 



Hj.pV/,A;. By (10 1, the covariance of the equivalent noise of dual link / is 



W(, + Eii H[,^Bl_^WgBi,,H[, = W[, + Yr,=i H|)^bI ,^W,Bi,gH(, = W;. Note that 

Q Q L Q Q 

9=1 9=1 i=l 9=1 q'=q 

L / Q \ Q Q 

= E tH E HbB,,Q W.Bj^QH^t \+J2Yl ^.9' ■ 



1=1 



9=1 



9=1 



9 =9 



Hence, the linear constraint in ( 12 1 can be expressed as ^i" ( j + Pc < Pt- The above proves 



the equivalence between the dual B-MAC AF relay network under constraint ( [12] ) and the B-MAC IFN 
in ( pT] ). The equivalence between the B-MAC AF relay network under constraint (|7]l and the B-MAC 
IFN in ([24]) can be proved similarly. 



B. Proof of Theorem [?] 

Recall that ti^m, ^i.m, * and D are obtained using (18 1, (19 1, (21 1 and (22 1 in Definition |2] with 



W, 



parameters | [H;_fc] , [W^ 
Definition |2j with parameters | [H/ fc] , [Wj] , 
depends on Xl and { [H^^fc] , [W^] }, we have 



|. Since XI (d) is the covariance transformation of XI obtained by 
|, using the fact that ti^m, ^i,m, * and D only 



W, (d) 



M, 



% (d) = ^ qi,mri,mr^ 



1,...,L, 



m=l 



where {qi,m} is given by 



q= (D-i-*'^)"' 



,9=0 



(59) 



and n^'s are defined in (32i. Note that 



L Ml 



J]Tr (d) W[^+i = E E 4-^^+1^'.-^"^^ 



Z=l »n=l 



^-1 



g'=0 



(60) 



where (|60|-a) follows from (pT|) and p9\, and (|60l-b) follows from the definition of a^ g' 's in (|30|l. Hence 



the first linear constraint in (35 1 can be expressed as 



5'=0 



(61) 



Similarly, = 1, Q, 



Tr(S,«(d)W, 



9 

L Ml 



/=1 m=l g'=g 



(62) 



Q-i Q 

E ^g'+i'^g-i,!}' +S-i,Q + E ^g'+i^q,q'' 

q'=0 q'=q 



q =q 



where (62i follows from (30 1 and (26), and thus the other linear constraints in (35 1 can be expressed as 
Q-l Q 

E + + E '^q'+A,q' = ^gPg-l, 9 = 1, Q- (63) 

q'=0 q'=q 



Now replace Pg'"s in (61 1 and (63 1 with APg'"s, we obtain another set of equations 

Q-l 

E '^g'+l^Q.g' + = XPq, 

q'=0 

Q-l Q 

E '^q'+l^q-l,q' + E '^Q +A,q' = ^9^-^9-1' 1 = 
q'=0 q'=q 



(64) 



It can be verified tliat tlie equations in ( [64] ) forms the eigensystem Ad = Ad in p4\ , where A G 
j^(Q+i)xQ+i ^gflj^g^ ,33,^ ^ [di,...,dQ,lf. Note that qqa > due to nonsingularity of W^_^/s 



and Wq's. Furthermore, since W^'s and Wg's are assumed to be non-singular and Fg / 0, g = 1, Q, 
we have 6g ^ > 0, q = 1, ...,Q. Using these facts, the following lemma can be proved. 



Lemma 1. The following is true for A defined in {33). 1) A > and A 0. 2) For any A and d 
satisfying Ad = Ad, if any element of d is zero, then d = 0. 

It follows from Lemma [T] and the Perron-Frobenius theorem p6l Chp. 8] that the maximum eigenvalue 
Amax and the associated dominant eigenvector d' of A satisfies Amax > and d' > 0. Then we can always 
obtain a scaled eigenvector d = d /dn^^ = di, dg, 1 



that satisfies Ad = Amaxd. On the other 
hand, it follows from (|29|l that Amax is equal to 1, which indicates that Jl ^d^ and F satisfies (35 1. 



C. Proof of Theorem [6] 

By Corollary [2| S satisfies the PWF structure for fixed F and the KKT condition in (44i with F = F. 
To prove that 51, F is a stationary point, we only need to further show that S,F satisfies 



V 



F,(i) 



Lx (S,F) =0, yq=l,...,Q,j = l,...,ng. 



(65) 



Since 1],F is a stationary point of the dual problem (48 1, we have Vp (j)^A f^-^) ~ Oi^'Zii- I^i the 



following, we prove that Vf^^a (^) F) = (Vp L;^(S,Fjj , Vg, from which ( 65 1 follows immediately. 



Note that for fixed F^' , Vg / g and F^' , Vg ^ q, problem (40 1 and (48 1 can be equivalent to the inner 
loop problem and its dual for a two-hop B-MAC AF relay network. Hence, without loss of generality, we 
only need to consider the two-hop case (i.e., Q = 1) and prove that VfL\ (S, F) = ( V^Lx ( SI, F 



Using (45 1 in Corollary |2J and the expression of Vf^a (^)Fj in (51 1, it can be shown that 

L L _ L _ L _ 

VfLa(S,F) = -2^ J]0/,J/FSfc-2j]iiFWi-2j]iiFSi 



1=1 k=l 
L 



1=1 



1=1 



+2j2wi^i^7'ii[Flli'SiU'^ - 2 J] WiFS;, 



(66) 



1=1 



1=1 



where = HgSfcHo^ and S; = U.'^T,iU[. Similar, 

L L 

VpLx(t,F 



-2 E E ^kA'^^k - 2 S/FWi - 2 ^iFSi 

1=1 k=l 1=1 1=1 

L -_l - - L __ 

+2 wiK^i Hl/FH'i^SiH'i - 2 J] WiFS,. 



(67) 



1=1 



It follows from (|46]) and (|47]l in Corollary |2] that 



H'itf2-iHiFH[,5];H|/ = u'^tiUiFU^^Qi 'u'l (68) 



Combining (66 



68 1 and F = Pt, we have Vf^a (S, F) = (VpLx ( S, Fj ) . This completes the proof. 
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